Developing a ContextualizedMultimodal Corpus for Human-Robot Interaction
نویسندگان
چکیده
This paper describes the development process of a contextualized corpus for research on Human-Robot Communication. The data have been collected in two Wizard-of-Oz user studies performed with 22 and 5 users respectively in a scenario that is called the Home Tour. In this scenario the users show the environment (a single room, or a whole floor) to a robot using a combination of speech and gestures. The corpus has been transcribed and annotated with respect to gestures and conversational acts, thus forming a core annotation. We have also annotated or linked other types of data, e.g., laser range finder readings, positioning analysis, questionnaire data and task descriptions, that form the annotated context of the scenario. By providing a rich set of different annotated data, the corpus is thus an important resource both for research on natural language speech interfaces for robots and for research on human-robot communication in general.
منابع مشابه
An Experimental Study on Blinking and Eye Movement Detection via EEG Signals for Human-Robot Interaction Purposes Based on a Spherical 2-DOF Parallel Robot
Blinking and eye movement are one of the most important abilities that most people have, even people with spinal cord problem. By using this ability these people could handle some of their activities such as moving their wheelchair without the help of others. One of the most important fields in Human-Robot Interaction is the development of artificial limbs working with brain signals. The purpos...
متن کاملDesign and development of ShrewdShoe, a smart pressure sensitive wearable platform
This study introduces a wearable in-shoe system for real-time monitoring and measurement of the plantar pressure distribution of the foot using eleven sensing elements. The sensing elements utilized in ShrewdShoe have been designed in an innovative way, they are based on a barometric pressure sensor covered with a silicon coating. The presented sensing element has great linearity up to 300...
متن کاملThe H 3 R Explanation Corpus Human - Human and Base Human - Robot Interaction Dataset
Natural interaction between humanoid robots and humans is one of the major goals of the HRI field. Two major requirements for advancing this direction of research are the availability of human–human and base human–robot interaction datasets for training and evaluation purposes and the availability of general agreed upon objective metrics for judging the performance of proposed robots and algori...
متن کاملDeveloping crossmodal expression recognition based on a deep neural model
A robot capable of understanding emotion expressions can increase its own capability of solving problems by using emotion expressions as part of its own decision-making, in a similar way to humans. Evidence shows that the perception of human interaction starts with an innate perception mechanism, where the interaction between different entities is perceived and categorized into two very clear d...
متن کاملMultimodal Corpus Collection for the Design of User-Programmable Robots
In order to design a robot able to learn from its user, the example of card game instruction is investigated. A detailed description of a setup for the collection of a human-to-human multimodal instruction corpus is given. This setup uses touch screens and will also provide a base for the human-robot instruction interface to be designed. Preliminary results on learning dialogues are given and i...
متن کامل